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© Image processing system. 

0 In a system for transmitting a video signal ob- 
tained by a camera to a discrete device either via a 
recording/reproducing system or via a transmission 
line, an image processing system includes a circuit 
which is arranged within the camera to generate a 
photo-taking state signal indicating information on 



aberrations in particular; and a correction circuit 
which is arranged within a device for reproducing or 
receiving the video signal to correct the aberrations 
of the video signal in accordance with the photo- 
taking state signal. 
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IMAGE PROCESSING SYSTEM 



Background of the Invention: 



Held of the Invention: 

This invention relates to an image processing 
system and more particularly to an image process- 
ing system which is arranged to correct the aberra- 
tion of a photo-taking optical system in an image 
recording/reproduction system or a transmission 
system. 

Description of the Related Art: 

The photo-taking optical system of a video 
camera or the like is designed to minimize the 
aberration thereof- Despite of the design, however, 
it is inevitable to have some degree of aberration 
remaining there. A method for digitally correcting 
the residual aberration has been disclosed in an 
article entitled "Real Time Correction of Deviation 
of Dynamic Registration caused by Lens" and ap- 
peared in the "Technical Reports". TEBS 96-4. 
1984. of the Television Society. 

In accordance with the above-stated prior art 
method, optical information such as the focal 
length, the focusing state, the aperture value, etc. 
of the photo-taking lens is read out from a lens 
barrel part and an aberration taking place in the 
photo-taking state of the lens is computed (or an 
aberration value which has been computed and 
stored in a memory is read out); and the aberration * 
is corrected by controlling mainly the scanning 
position of a camera tube. 

The term "aberration" as used herein includes 
an image distortion which is shown in Fig. 6(a) of 
accompanying drawings; a lateral chromatic aberra- 
tion shown in Fig. 6(b); parallel color deviation 
shown in Fig. 6(c); and a shading as shown in Fig. 
6(d). The aberrations shown in Fig. 6(a), 6(b) and 
6(d) result from the optical factors of the photo- 
taking lens and depend on the state of the lens. 
The aberration shown in Fig. 6(c), on the other 
hand, either results from an error in mounting posi- 
tion of the camera tube, a solid-state image sensor 
or the like or results from rattling, slanting and 
decentering which take place while the lens is 
moved. 

The aberration correcting method mentioned 
above is intended to obtain an aberration-corrected 
signal when it is output from the camera tube and 
is thus applicable only to the camera tube. It is not 
applicable to a solid-state image sensor, because: 
In the case of the solid-state image sensor, many 



photo-electric conversion elements are fixedly ar- 
ranged in a matrix-like state. Their positions are 
thus invariable. Further, the use of the camera tube 
is undesirable because of its large size, a high cost 

5 and a short life. It is, therefore, impractical to use 
camera tubes and, hence, the above-stated method 
for general consumer appliances. 

It is conceivable to solve the above-stated 
problem by temporarily storing image information 

10 output from a solid-state image sensor in an image 
storage device which is composed of a semicon- 
ductor memory and by subjecting it to an aberra- 
tion correcting process. However, the image stor- 
age device must be arranged to permit random 

75 access. Then, a large address circuit is necessary 
for random access. In addition to that, the method 
necessitates use of a large, high-speed computing 
circuit in carrying out address computation for ab- 
erration correction. This increases the size and 

20 weight of the camera. 



Summary of the Invention: 

25 It is, therefore, an object of this invention to 

provide an image processing system which is ca- 
pable of giving a substantially aberration-corrected 
image signal without causing the inconveniences 
mentioned above. 

30 The image processing system according to this 

invention is characterized in that: In a system for 
transmitting a video signal obtained by a camera to 
a recording/reproducing device or to a discrete 
device via a transmission line, the camera is pro- 

35 vided with generation means for generating a 
photo-taking state signal which is arranged to in- 
dicate the aberration. In combination with this, the 
video signal reproducing or receiving • device is 
provided with correction means for correcting and 

40 adjusting the aberration of the video signal accord- 
ing to the photo-taking state signal received. 

The above-stated generation means enables 
the video signal reproducing or receiving device to 
know information on the aberration or a camera 

45 shake taking place in shooting. The video signal 
thus can be corrected by the correcting means 
according to such information. The correcting ac- 
tion does not require the camera itself to have any 
large special circuit. Therefore, the camera can be 

so arranged to be compact in size and light in weight. 
Since the condition of each individual shot is de- 
tectable, the correction can be appositely accom- 
plished according to the condition. A picture thus 
can be obtained in high quality. Further, since the 
shooting condition is not to be detected from the 
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video signal, the correcting means can be arranged 
in a relatively simple manner. 

The above and further objects and features of 
the invention will become apparent from the follow- 
ing detailed description of embodiments thereof 
taken in connection with the accompanying draw- 
ings. 

Brief Description of the Drawings: . 

Fig. 1 is a block diagram showing the arrange- 
ment of a photo-taking and recording apparatus 
arranged as an embodiment of this invention. Fig. 2 
is a block diagram showing the arrangement of a 
reproducing apparatus arranged also according to 
this invention. Fig. 3 shows the storage addresses 
of an image memory which is included in Fig. 2. 
Fig. 4 is a block diagram showing the arrangement 
of another embodiment of the invention which uses 
a radio transmission device. Fig. 5 is a block dia- 
gram showing the arrangement of a photo-taking 
and recording apparatus arranged according to this 
inyen tion to perform shake correction. Figs. 6(a) to 
6(d) are illustrations of aberrations. 

Detailed Description of the Preferred Embodiments: 

Some embodiments of this invention are de- 
scribed below with reference to the accompanying 
drawings: 

An embodiment of the invention which is in- 
cluded in a system for transmitting a picked up 
image through an image recording/reproducing 
system to a video tape is first described. Fig. 1 
shows in a block diagram the arrangement of a 
video camera included in the embodiment of the 
invention. Referring to Fig. 1, the video camera 10 
comprises a zoom lens 12; solid-state image sen- 
sors 14, 16 and 18 which are arranged to form 
signals of red (R), green (G) and blue (B) colors 
respectively; and a video signal processing circuit 
20 which are arranged to form a color video signal 
by performing known processes on the outputs of 
the solid-state image sensors 14. 16 and 18. A 
recording circuit 22 is arranged to record the color 
video signal output from the video signal process- 
ing circuit 20 on a video tape together with an 
aberration information code which will be described 
later herein. The recording circuit 22 can be ar- 
ranged either in one body with the video camera 
10 or separately from the video camera 10. 

To detect the state of a zoom lens 12, the 
video camera 10 is provided with a potentiometer 
24 which is arranged to detect the rotational posi- 
tion of the distance ring (indicating the object dis- 
tance) of the zoom lens 12; a potentiometer 26 



which is arranged to detect the focal length of the 
zoom lens 12; and another potentiometer 28 which 
is arranged to detect the aperture value of an iris. 
An A/D (analog-to-digital) converter 30 is arranged 
5 to digitize the outputs of the potentiometers 24, 26 
and 28. A ROM 32 is arranged to store aberration 
information codes which have previously been ob- 
tained according to the conditions (the object dis- 
tance, the focal length and the iris aperture value) 
io of the zoom lens 12 which is in use. A digital 
computing circuit (microcomputer) 34 is arranged 
to read the contents of the ROM 32 according to 
the output of the A/D converter 30 and to supply 
applicable aberration information to the recording 
15 circuit 22. 

The video camera shown in Fig. 1 operates as 
follows: The video signal processing circuit 20 per- 
forms in a known manner a video signal processing 
action on the signals output from the image sen- 
20 sors 14, 16 and 18. A color video signal thus 
obtained is supplied to the recording circuit 22. 
The potentiometers 24, 26 and 28 detect the con- 
ditions of the zoom lens 12 obtained at the time of 
shooting. The outputs of these potentiometers are 
25 digitized and supplied to the computing circuit 34. 
The computing circuit 34 then looks up a table 
stored in the ROM 32 according to the digital 
signals output from the A/D converter 30. An ap- 
plicable aberration information code is read out 
30 from the ROM 32. The code thus read out is then 
supplied to the recording circuit 22 in a signal form 
suited to the recording process of the recording 
circuit 22. The use of the ROM 32 enables the 
embodiment to reduce the amount of the signal or 
35 that of data to be recorded on the video tape by 
the recording circuit 22 for the purpose of transmit- 
ting aberration information. However, it is of course 
possible to supply the analog data obtained from 
the potentiometers 24, 26 and 28 to the recording 
40 circuit 22 as it is as the aberration information code 
without digitizing it. 

The recording circuit 22 is arranged to cor- 
relate the color video signal output from the video 
signal processing circuit 20 with the aberration 
45 information output from the computing circuit 34, 
for example, by frequency or time base multiplex- 
ing them and to record them on the video tape. 

The lens information to be transmitted to the 
video tape includes the distance ring position, the 
so focal length, the aperture value, the lens type 
(model number), and the parallel position deviation 
such as a relative position discrepancy which ar- 
ises between channels when the image sensors 1 4, 
16 and 18 are fixed to a spectral prism or is 
55 caused by the rattling, slanting and decentering 
taking place in a mechanical part. The lens in- 
formation or data may be a design value or a 
measured value obtained upon completion of as- 
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sembiy work on the lens barrel. 

Fig. 2 is a block diagram showing the arrange 
ment of a system for reproducing and aberration- 
correcting the record of a video tape on which the 
video signal and the aberration information are re- 
corded by the arrangement of Fig. 1. The system 
includes a reproduction circuit 36 which is arranged 
to reproduce the video signal and the aberration 
information from the video tape. An image memory 
38 is arranged to. have storage spaces for the 
channels of the colors R, G and B and to permit 
random access. A computing circuit 40 is arranged 
to generate a reading address for correcting any 
aberration, in the image memory 38 according to 
the aberration information reproduced by the re- 
production circuit 36. 

The video signals of the color channels repro- 
duced by the reproduction circuit 36 are separated 
from each other and are serially stored in the 
image memory 38 in the horizontal and vertical 
directions thereof. In other words, the writing ad- 
dress of the image memory 38 varies in the hori- 
zontal and vertical directions. In accordance with 
the aberration information output from the repro- 
duction circuit 36, the computing circuit 40 two- 
dimensionally computes the shape of the gener- 
ated aberration according to the aberration informa- 
tion output from the reproduction circuit 36 and 
generates the reading address for correcting the 
aberration- The video signal is thus read out from 
the image memory 38 in such a way as to correct 
through the reading address the aberration which 
took place at the time of photo taking, or shooting. 

The manner in which the image memory 38 is 
accessed is described as follows with reference to 
Fig. 3: In Fig. 3, a distortion curve 42 indicates the 
shape of the image distortion resulting from the 
state of the lens at the time of shooting. A line 44 
represents the horizontal line of the two-dimen- 
sional allocation of image data stored in the image 
memory 38. Assuming that the horizontal line 44 is 
distorted as represented by the curve 42 by the 
aberration of the photo-taking lens and that the 
picture element addresses in the vertical and hori- 
zontal directions V and H are expressed as Pi j, the 
picture element data are read out along the distor- 
tion curve 42 as the image data are stored in the 
image memory 38 with the true horizontal line 44 
warped by the photo-taking lens to a shape as 
represented by the distortion curve 42. Referring to 
Fig. 3, the picture element data are thus read out 
one after another in the order of hatched picture 
elements P1,1. P1.2. P2,3, P2,4 P3,5, P3.6, — . 
Upon completion of reading one line amount of 
data in the horizontal direction, the addresses in 
the vertical direction are changed to correct image 
distortion, of course, in the vertical direction. An 
image distortion in the horizontal direction is of 



course corrected in the same manner. 

In reading the picture element data from the 
image memory 38, picture quality can be improved 
by performing interpolation between adjacent pic- 

5 ture elements. Further, while the aberration is cor- 
rected in reading the data from the image memory 
38, the aberration correct ing process may be 
changed to be likewise performed in writing the 
data into the image memory 38. 

70 In accordance with' the arrangement shown in 

Figs. 1 and 2, the image recording and image 
reproduction can be accomplished in different 
places of operation. Therefore, the camera can be 
arranged to be small in size and light in weight for 

is taking high-quality pictures. The system arrange- 
ment is advantageous particularly for outdoor 
shooting. It is also applicable to a case where each 
cut of pictures taken and recorded by a HDTV 
(high-definition TV) system or the like is to be 

20 printed, in this case, the aberration correction does 
not have to be carried out in real time. Therefore, 
the image memory 38 and the computing circuit 40 
can be allowed to operate at a relatively low speed 
by using, for example, a general purpose com- 

25 puter. 

While the image and aberration information are 
arranged to be transmitted by means of a video 
tape in the case of the arrangement shown in Figs. 
1 and 2, the arrangement may be changed to 

30 transmit the information by radio transmission. In 
that case, the camera part still can be arranged in 
small size and light weight. An example of such 
arrangement is shown in Fig. 4. 

Fig. 4 is a block diagram showing in outline the 

35 above-stated radio transmission arrangement as an 
embodiment of this invention. In Fig. 4, a reference 
numeral 50 denotes a portable video camera. The 
video camera 50 is provided with the potentiom- 
eters 24, 26, 28, the A/D converter 30, the ROM 32 

ao and the computing circuit 34 of Fig. 1. In addition 
to them, the video camera 50 includes an aberra- 
tion information encoder 52 which is arranged to 
produce a signal indicating aberration information 
obtained at the time of shooting, and a transmis- 

45 sion circuit 54 which is arranged to send out by 
radio transmission the aberration information signal 
of the encoder 52 along with a video signal ob- 
tained by shooting. The signal transmitted by the 
transmission circuit 54 is received by a receiver 56. 

so Then, the aberration correction is carried out by an 
aberration correcting unit 58 which includes the 
image memory 38 and the computing circuit 40 of 
Fig. 2. An editor 60 is arranged to be used for 
editing the aberration-corrected video signal which 

55 is supplied from the aberration correcting unit 58. 

In the case of the arrangement shown in Fig. 4, 
aberration correction is not performed on the side 
of the camera. Therefore, the camera 50 can be 
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arranged small in size and light in weight for ob- 
taining high-quality images. This arrangement is 
highly advantageous, for example, in cases where 
the camera is carried around outdoors for shooting 
a marathon race by relay transmission and where 
the camera is used for an unattended monitor 
system. 

The invention is applicable to the prevention of 
image shaking caused by the vibrations of the 
camera holding hands and also to the correction of 
an image shake taking place in shooting with a lens 
of a long focal length. In the case of shooting with 
the camera held by hand, the camera is shaken by 
the breathing or walking movement of the camera 
operator. The shaking of the camera tends to show 
a salient picture shake particularly in the event of a . . 
lens of a long focal length. A method for detecting 
such picture shaking from a reproduced video sig- 
nal and to correct it on a memory has been dis- 
closed by an article entitled "Picture Shake Cor- 
recting Device" and appeared in the Journal of TV 
Society, Vol 111, No. 3, p 43 - 48, PROE '87 - 12 
(May, 1987). In accordance with this method, how- 
ever, the shake must be detected from a picture 
reproduced, this not only requires the use of a 
large piece of hardware but also tends to cause an 
error in the case of an image having a low degree 
of contrast. Besides, it tends to be affected by the 
jitters, etc. of the video tape. 

Fig. 5 is a block diagram showing the arrange- 
ment of the photo-taking/recording part of an em- 
bodiment of this invention which solves these prob- 
lems of the prior art. Referring to Fig. 5, a camera 
body 70 is provided with gyro-sensors or vibration 
sensors 72 and 74 which are secured to the cam- 
era body 70. The sensors 72 and 74 are arranged 
to detect the horizontal rotation angle e and the 
vertical rotation angle <f> of the camera body 70. 
The shaking degree of the picture due to the 
rotation (or shake) of the camera is proportional to 
the product of the rotation angle of the camera and 
the focal length of the s lens. Therefore, the focal 
length is obtained by the potentiometer 76 and the 
product of the rotation angles 6 and 0 by multipli- 
ers 78 and 79. The encoder 80 obtains information 
on the shake of the camera from the outputs of the 
multipliers 78 and 79 and supplies it to the record- 
ing circuit 82 by encoding it. Meanwhile, the video 
signal obtained by the camera body 70 is also 
supplied to the recording circuit 82. The recording 
circuit 82 records the shake information from the 
encoder 80 on the video tape along with the video 
signal from the camera body. Although it is not 
shown, aberration information of course may be 
also supplied to the recording circuit 82 to be 
recorded also on the video tape in the same man- 
ner as described in the foregoing. 

To correct the above-stated image shake, the 



record of the video tape on which the video signal 
and the shake information are recorded by the 
recording circuit 82 is reproduced by a reproducing 
device. Then, the video signal reproduced is first 
s stored in the image memory. After that, in accor- 
dance with the shake information reproduced, the 
reading area of the image memory is shifted in the 
horizontal and vertical directions to an angular ex- 
tent corresponding to the shaking angle in the 
io direction opposite to the direction of the shake. 
This arrangement of course may be changed to 
shift the writing area, instead of the reading area, of 
the image memory to the degree of an angle 
corresponding to the shake in the opposite direc- 
75 tion. In correcting the pic ture shake, the correcting 
process can be performed in the same manner for 
all the color channels. Besides, the shake correc- 
tion can be accomplished without many complex 
computing operations, so that the embodiment can 
20 be arranged with a simple hardware arrangement 
As apparent from the foregoing description, the 
embodiment is arranged to correct the image dis- 
tortion during the process of reproduction in accor- 
dance with aberration information which indicates 
25 any aberration that takes place at the time of 
shooting in cases where the image distortion re- 
sults from the aberration of the photo-taking lens. 
Therefore, the invented arrangement gives a high- 
duality picture by minimizing the image distortion. 
30 Another advantageous feature of the invention re- 
sides in that: The aberration correcting circuit is 
arranged discretely from the camera. Therefore, 
the size and weight of the camera can be pre- 
vented from increasing. It is a further advantage of 
35 the invention that the image shake resulting from 
the shaking of the camera is corrected at the time 
of reproduction, so that images can be stably re- 
produced even in cases where a lens of a long 
focal length is used. 
40 In a system for transmitting a video signal 

obtained by a camera to a discrete device either 
via a recording/reproducing system or via a trans- 
mission line, an image processing system includes 
a circuit which is arranged within the camera to 
45 generate a photo-taking state signal indicating in- 
formation on aberrations in particular; and a correc- 
tion circuit which is arranged within a device for 
reproducing or receiving the video signal to correct 
the aberrations of the video signal in accordance 
so with the photo-taking state signal. 



Claims 

1. In a system for transmitting a video signal 
obtained by a camera to a separate device either 
via a recording/reproducing system or via a trans- 
mission line, an image processing system compris- 
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mg: 

a) signal generating means disposed in a 
camera and arranged to generate a photo-taking 
state signal indicating a photo-taking state; and 

b) correcting means disposed in a video 5 
signal reproducing or receiving device in said sep- 
arate device and arranged to correct the video 
signal according to said photo-taking state signal 
generated by said signal generating means. 

2. An image processing system according to io 
claim 1, wherein said photo-taking state signal 
which indicates a photo-taking state includes in- 
formation on an aberration. 

3. An image processing system according to 
claim 1, wherein said photo-taking state signal 75 
which indicates a photo-taking state includes in- 
formation on a shaking of said camera. 

4. A camera comprising: 

a) photo-taking optical system; 

b) image sensing means for sensing an op- 20 
tical image obtained through said photo-taking op- 
tical system; and 

c) transmission means for transmitting an 
image signal obtained by said image sensing 
means and information on the characteristics of 25 
said photo-taking optical system in a separably 
mixed state. 

5. A camera according to claim 4, wherein said 
transmission means includes recording means. 

6. A camera according to claim 4, wherein said 30 
transmission means includes signal sending 
means. 

7. A camera according to claim 4, wherein said 
information on the characteristics of said photo- 
taking optical system includes information on an 35 
aberration of said photo-taking optical system. 

8. A camera according to claim 4, wherein said 
information on the characteristics includes informa- 
tion on a shaking of said photo-taking optical sys- 
tem. 40 

9. A camera according to claim 4, further com- 
prising correction means for correcting, on the ba- 
sis of said information on the characteristics, the 
image signal transmitted via said transmission 
means. 45 

10. A camera according to claim 9, wherein 
said correction means is disposed in a reproducing 
device which is arranged separately from said 
camera. 

11. A camera according to claim 9, wherein 50 
said correction means includes a memory. 

12. A camera according to claim 4, wherein 
said transmission means includes a memory. 

13. A reproducing device comprising: 

a) receiving means for receiving, from a sep- 55 
arate image sensing device, an image signal ob- 
tained by said image sensing device and a signal 
indicating information on the characteristics of a 



photo-taking optical system of said image sensing 
device; and 

b) correction means for correcting said im- 
age signal by using said signal indicating informa- 
tion on the characteristics received by said receiv- 
ing means. 

14. A device according to claim 13, wherein 
said receiving means includes reproducing means. 

15. A device according to claim 13. wherein 
said receiving means includes signal receiving 
means. 

16. A device according to claim 13, wherein 
said information on the characteristics of said 
photo-taking optical system includes information on 
an aberration of said photo-taking optical system. 

17. A device according to claim 13, wherein 
said information on the characteristics includes in- 
formation on a shaking of said photo-taking optical 
system. 

18. A device according to claim 13, wherein 
said correction means includes a memory. 

19. A device according to claim 14, wherein 
said image sensing device includes recording 
means for separably recording, on a recording me- 
dium, said image signal and said signal indicating 
information on the characteristics. 

20. A device according to claim 19, further 
comprising reproducing means for reproducing 
said image signal and said signal indicating in- 
formation on the characteristics which are recorded 
on the recording medium. 
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© In a system for transmitting a video signal ob- 
tained by a camera to a discrete device either via a 
recording/reproducing system or via a transmission 
line, an image processing system includes a circuit 
which is arranged within the camera to generate a 
photo-taking state signal indicating information on 



aberrations in particular; and a correction circuit 
which is arranged within a device for reproducing or 
receiving the video signal to correct the aberrations 
of the video signal in accordance with the photo- 
taking state signal. 
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